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Abstract — In this study, a novel computational framework 
for solving a class of optimal control problem for systems 
governed by non-linear Hammerstein integral equations is 
presented. A theorem for the convergence and the validity of the 
approach is also given in detail. Numerical experiments and 
comparisons with exact solutions confirm the efficiency and the 
accuracy of the proposed technique. 

Index Terms — Optimal Control problem, Non-linear 
Hammerstein integral equations, Iterative methods, 
Approximate-analytical solution. 


I. Introduction 

Iterative schemes and optimizations related to integral 
equations are two prominent fields of research in applied 
science and engineering. The major purpose of optimization 
is to determine procedures of how optimally change or 
influence real systems to achieve a desired result. This 
requires to realize large-scale optimization strategies with 
increasing complexity which in turn motivates the 
development of numerical techniques for optimization 
purposes. 

On the other hand, in mathematical formulation of physical 
phenomena, integral equations are always encountered and 
have attracted much attention. In fact, integral equations are 
as important as differential equations and appear in a variety 
of applications in many fields including continuum 
mechanics, potential theory, geophysics, electricity and 
magnetism, kinetic theory of gases, hereditary phenomena in 
biology, quantum mechanics, mathematical economics, 
population genetics, medicine, fluid mechanics, steady state 
heat conduction, and radiative heat transfer problems [1,3,6, 
7, 9, 10, 12, 13, 14, 21, 23, 25], In this way there are many 
direct and indirect numerical solution for integral equations 
such as [2, 5, 17, 17, 22], Furthermore, optimal control of 
systems governed by integral equations are momentous in 
applications such as the optimal control problem related to the 
Ornstein-Uhlenbeck process which arises from statistical 
communication theory [8]. In this paper, we focus on the 
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formulation of a class of optimal control problems governed 
by non-linear Hammerstein integral equations as follows 

Minimize J(x,u) = (1) 

subject to 

x(t) = y(t) + A, Jfc, (t, s, u(s))<t>(s, x(s))ds (2) 

+ j" o & 2 it, s, uis))Wis, x(s))ds, 

where the known function 

fo(t, xit), u(t )) e C([ 0,1] X R x R) and 

y(t), ® (f , x it)), Wit, x(t)), k x {t, s, uis)), k 2 {t, s, uis )) 
are given functions which are defined on the interval 
0 < t, s < 1 , and can be expanded to the Taylor series about 
f = c,0 < C < 1 . Besides, x(f),w(f) e C°°([0,1]) are the 
trajectory and control functions, respectively. Here, it is 
assumed that the problem (l)-(2) has a unique solution. 

Nevertheless, there is no research to solve the optimal control 
problem (l)-(2). Thus, the main purpose of this study is to 
construct an iterative scheme to obtain the approximate 
solution and also the analytical solution of the problem in the 
form of polynomial series solution. 

II. Taylor solution 

In this section, following the work of Mahmoodi [11], it is 
assumed that for a given uis) , the non-linear integral 
equation(2), for which yit), ®(f, x(f )), *+*(7 , x(t)) , 
k, it, S, uis)) and k 2 it,s,uis)) are functions that have 
suitable derivatives in the interval 0 < S, t < 1 , has the 
solution x(t) in the form 
N 1 

xit) = V— x (n) ic)it - c) n , 0<t,c<l. (3) 

t^n\ 

Noting that, Eq.(3) is a Taylor polynomial of degree N at 
t = c , where X (n> ic ) , n = 0, 1 ,..., N are coefficients to be 
determined. 

Using Eq.(3), we also consider ®(7, xit)) and 
Wit, xit)) in Eq.(2) expressed in terms of Taylor 
polynomials as 
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0(t,x(t)) = Y-t n (t-c) n , 0<f,C<l. (4) 

x V(t,x(t)) = Y- V f n (t-c) n , 0<t,c<l. (5) 

t=on\ 

Which are Taylor polynomials of degree N at t = c . The 
coefficients <f> n ,l// n ,n = are non-linear 

combinations of X (0> (c),X 0> (c),...,X (N> (c) as follows: 

K = 0(t,x(t)) 

, ao „ A ao 

6, = — + x (t) — 

' dt dx 

, d 2 o „ N 80 80 , u , d 2 o „ r 80 

(/) 2 =— T + x(t) — — + (x{t)) ~Y + X (0 — 
8t dx dt dx dx 

, a 3 0 . , (/ .aoao a 2 0 50 

6, = — r + 2 x"(t) + 2(x (t)y — = + 

^ dt 3 dx dt dx 2 8t 

_ ... . ,..a 2 0 ,..aoa 2 0 .. 3 5 3 $ 

3a: (t)x (t)— r + x(t)— — r + (x(f )) : — — 

dx dx dt~ dx 

+ x (f) — 
dx 


A. Matrix representation of the components 

To obtain the solution of (2) in the form of 
expression (3), we first differentiate it n times with respect 
to t : 

d n , 


x (,,) (t) = y M (t) + \ [ k x (t , s, u(s))0(s, x(s))ds 

dt n Jo 

Jo f)t " 


( 8 ) 


and then analyse it as matrix representation. 

According to [15], Eq.(8) can be written as 
x M (t) = y M (t) + \V (n \t) + V w (f) (9) 

where 

V (n) (t) = — f kdt,s,u(s))0(s,x(s))ds 
dt n Jo 
and 

p M^ = j 1 d n k 2 (t,s,u (s )) u 

Here, we have 




V (0 \t ) = j\(f, s, u(s))0(s, x(s))ds, 
V (1 \t ) = ^a,5,M(y))O(f,x(0)O(y,A:(y))Jy, 


^ 0 = 'F(f,x(f)) 

5T „ . dT 
= ^- + ^(0— 
dt dx 

d lx ¥ „ , 5T » 8 2x ¥ 

^ = W + X(t) ^ + (x(t)) ^ 
x ay 

+ x"(t) — 
dx 

a 3 T _ „ . . ay ay _ . , . ^ a 2 T ay 

V / 3 = ^T + 2x (t)—— + 2(x(t)) — ^ — 
dt dx dt dx dt 

n , ,, A d 2 W „ . ay a 2v F 

+ 3x (r)*(0-^i- + *(0 . 

ax ax at 

, aa3 a 3v F A ay 
+(x(0) -tt +x CO- 

ax ax 


r' dk x (t,s,u(s )) 

a 

V«(» = 2O(t,x(0) ^ (M ’ MW) 

dt 


dO(t x(t)) 80 

f s, wO)) V " s,u(s))x'(t ) — 

a? ax 


Ja at 


y (3 V?) = 30 d k^t^sMs)) + 3 dk x (t,s,u{s )) aO(r,x(Q) 
a? a? a? 

+ dk x (t,s,u(s)) 8Q(t, x(Q) 

a? ax 


7 / / xw 7s2 a 2 O(r,x( 0 ) 

b^j(f,y,M(5))(x) 
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f fc, (t,s,u(s)) 


d 2 ®(t,x(t )) 


dt 


•t d 3 k l (t,s,u(s )) 

» sT 
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x M (c) = y (n \c)+A±H n J m +A^_K nm y m 

m = 0 m = 0 

where 


®(s,x(s))ds. 


and then 

v (n \t)=Yjih l (tmt,xm (n ~ , ~' 


•* d n k l (t,s,u(s)) 
dt" 


®(s,x(s))ds. 


h .(t) = d ‘ k i (f ’ s ’ u W) \ 

dt 1 

Using Liebnitz's rule, we obtain 

V w (t) = 

[ (n-i- 1) 






r‘ d n k,(t, s, u(s)) ... 

+ -Q>(s,x(s))ds. 

Jo dt n 

Note that, in Eq.(l 1), 

eT !;<•••)• 


Eqs.(3), (4) and (5), we obtain 

-i - 1 


' ,<, V)=EE 

!=0 1=0 

{ Y 1 , pc d n k 1 (t,s,u(s)) 

"Jo A?" 


and 




Uc ( s-c) m ds 


^>=e>j: 


ft d n k 2 (t,s,u(s)) 
~dt n 


Uc ( s-c) m ds . 

(13) 


Substituting Eqs.(12) and (13) in Eq.(9) gives 

x <n] (c) = 

Wi [.a^yW) 

I&ml " at 


Sf" 

or, briefly, 


-Er 


d"k l (t,S,u(s)) 
dt n 


l \c) 


\ t=c (s-c)' n ds n>m 


K, 


1 tcd n k x (t,s,u{s )) , , ,m , . 

— 5 l,_ r (s-c) ds n<m 

^7.! Jo fi t n *- c 

die 

m \ Jo dt n 


; m =—f 


1 rid n k 2 (t,s,u(s)) 


Uc ( s-c) m ds . 


(17) 


If we take n = 0, 1 /V, relation (15) reduces to a system 
of TV + 1 non-linear equations for N + 1 unknown 
coefficients x m (c), X (l) (c),...,X {N) (c) , as follows: 

X=Y + \H^ + X 1 K^ (18) 

where 


(11) 

'x (0) (c)‘ 


V 0) (uT 


to 


Vo 


x (1) (U> 


/V) 


</>i 


V i 

X = 

x (2) (c) 

,Y = 

y 2) (c) 

«D = 

t 2 

,t = 

V 2 


* W (c) 


y m (c) 


t N 


Vn 


And H and K are (N + 1 ) x (TV + 1 ) matrices 
defined in (16) and (17). The non-linear system of equations 
obtained in (18) can be solved using standard mathematics 
toolboxes as MATLAB. 


III. The iterative method and its convergence 

Let Q be the subset of the product space 
C“([0,l])xC°°([0,l]) contains all pairs (x(.),w(.)) , 
which satisfy Eq.(2). Also, let Q m n be the subset of Q 
consisting of all pairs (x m (.),U n (.j) , where u n (.) is a 
parameterized control function as the following polynomial 

u n (t) = X a >t i ’ d 9 ) 

i=0 

and x m (.) is the extracted solution of the integral equation 
(2), which is considered as a polynomial of degree at most m 

xjf) = |^(a 0 ,a 1 ,...,a li y. (20) 

Here, e- ■ R n — > R, j = 0,1,..., m are continuous 

functions. Now, we consider the minimizing of J on Q m n 
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with {a k }l =0 as unknowns. This is obviously an 
optimization problem in n + 1 dimensional space 
{(a 0 ,a l ,...,a n )eR n+1 : 

a 0 = M »(°) = U 0 = U nW = M ll 

k=0 

and J{x m ,u n ) may be considered as a function 

Suppose, be the solution of 

minimizing J on Q mn ,m = 1,2, ; n = 1,2,..., then the 

polynomial form of U n (.),n = 1,2,... (19) and using (20) 
allow us to apply the proposed method (in Section 2) for 
extracting polynomial solution of (20), which results in 
obtaining a sequence of trajectory functions } m=1 as 

Taylor series, and finally to achieve a minimizing sequence 
{(<(•),<(•) ■ 


approximate solutions will be compared with the exact 
solutions. 

Example 1. Let us first consider the optimal control problem 
governed by Fredholm-Hammerstein integral equation as 
follows 


Minimize J = £(x(f) - 1 -t 2 ) 2 + ( u(t ) - 1 - t) 2 dt , 


subject to 

x(t) = y(t ) + jV x u(s ) x 'PCs, x(s))ds. 


( 21 ) 

( 22 ) 


where y(t) = - + t + 1 and W(t, x(t)) = t + x(t) . 

The exact optimal solutions of (21)-(22) are 
x*(t) = \ + t 2 and u*(t) = l + t, 
with the optimal criterion 

J = J(x*(t), u* (t)) = 0. 

In the first iteration, i.e. for n = 1 and m = 1 , we have 


{a m n }“ n=l is a convergent sequence. 

Proof. Proof in [16, 19]. 

Now, it can be concluded that {cc mn } is 
convergent, because it is a nondecreasing and bounded from 
below sequence. 

Theorem 1. If lim « m , n = a then a = inf q J ■ 
Proof. Proof in [16, 19]. 


m,n = 1,2,... , then 

W)" 


T 


'0 o' 

X = 

x IV. (V] (c) 

,Y = 

0 

,K = 

0 0 


* w (c) 
l + x (1) (c) 


In the next iteration and for n = 1 and m = 2 , we 


The above discussion and results can be 
summarized in a numerical algorithm for obtaining the 
approximate solutions for the optimal control (1) subject to 
Eq.(2). 

Algorithm 1. Choose £ l > 0 and £ 2 >0 for the accuracy 
of the solution. 

• Step 1. Let m, n, k = 1 , u x (t) = a 0 +a 1 t , 
x x (t) = e 0 + e x (t) and a x = J(x(\),u(\)) , where 

e o = e 0 (« 0 ’ a i) and = eMo’CO ■ 

• Step 2. Let m = m + 1 and k = k + 1 and find 
a k = inf Q m n J ■ 

• Step 3. If I OC k — Ot k | l< £ x then go to Step 4, otherwise 
go to Step 2. 

• Step 4. Let n = n + 1 and k = k + 1 , find 

a k = inf q J and go to Step 5. 

• Step 5. If I a k — a k _ x \< then stop, otherwise go to 
Step 4. 


IV. Numerical experiments 

Now, we show the efficiency of the method 
described using the following examples. In all examples, the 



V 0) (c)~ 


1 

X = 

^ (1) (c) 

x (2) (c) 

, Y = 

0 

-3.8333 

1 

0 

0 

0 

0 

0 

0 


2 a 0 + a { a 0 + (2a t )/3 aj 3 + aj 4 


x (0) (c) 


T = 


l + x a) (c) 
x (2) (c) 


So by using the iteration Algorithm 1 , the numerical 
results are illustrated in Table 1 and Figures 1-4. 


Table 1: The Approximate- Analytical results for Example 1 


Iter 

n 

m 

x(t) 

u(t) 

J 

1 

1 

1 

1 

1 +t 

0.2 

2 

1 

2 

1 +t 2 

1 +t 

0 
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Figure 1: Exact and approximate trajectory functions for 
Example 1, n = 1, m = 1 . 



Figure 2: Exact and approximate control functions for 
Example 1, n = 1, m = 1 . 



Figure 3: Exact and approximate trajectory functions for 
Example 1, n = 1, m = 2 . 



Figure 4: Exact and approximate control functions for 
Example 1, n = 1, m = 2 . 


Example 2. We consider the optimal control problem 
governed by Volterra-Hammerstein integral equation as 
follows 

Minimize J = f ( x(t ) - £ - £ 2 ) 2 + (w(f) - 1 - t 2 ) 2 dt , (23) 

Jo 

subject to 

x(?) = _y(f) + J t x m(s) x 0(y, x(s))ds. (24) 

, , 2I . - 2 1 2 

y(t) = t-t 


®(t,x(t)) = l + t+x(t). 

The exact optimal solutions of the problem (23)-(24) 
are 

x*(t) = t + t 2 and u*(t) = l + t 2 , 

with the optimal criterion 

J = J(x*(t),u(t)) = 0. 

Using the iteration Algorithm 1, the numerical results are 
illustrated in Table 2 and Figures 5-10. 


Table 2: The Approximate-Analytical results for Example 2 


Iter 

n 

m 

x(t) 

u(t) 

J 

1 

1 

1 

t 

0.8334 + t 

0.2056 

2 

1 

2 

t + 0.9074r 2 

0.9074 + 0.8889? 

0.0086 

3 

2 

2 

t + t 2 

1 + ? 2 

0 



Figure 5: Exact and approximate trajectory functions for 
Example 2, n = 1, m = 1 . 



Figure 6: Exact and approximate control functions for 
Example 2, n = 1, m = 1 . 
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Figure 7: Exact and approximate trajectory functions for 
Example 2, n = l,m = 2. 



Figure 8: Exact and approximate control functions for 
Example 2, n = 1, m = 2 . 




Figure 10: Exact and approximate control functions for 
Example 2, n — 2,m — 2. 


Example 3. Finally, Let us consider the optimal control 
problem governed by Volterra-Fredholm-Hammerstein 
integral equation as follows 

Minimize J = f (x(t) -t-t 2 ) 2 + (u(t)~ 1 - tfdt , (25) 

Jo 

subject to 

x(t) = y(t ) + ^exp(t) x u(s ) x <D(y, x(s))ds (26) 

+ ^ exp{t) x u(s ) x ^(s^is^ds. 

re'(f 3 +4t 2 +6t + 4) 

4 ’ 

®(f, jc(0) = 1 + 1 + x(0 and W(t, x(t)) = 1 + t + x(t) . 
The exact optimal solutions of (25)-(26) are 
x*(t) = t + t 2 , and u(t) = \+t, 
with the optimal criterion 

J = J(x\t),u\t)) = 0. 

Table 3 and Figures 11-14 give the numerical results for 
example 10. 

T able 3: The Approximate-Analytical results forExample 3 


, . 15e f z . 

where y(t) = t 1 -t — 

4 


Iter 

n 

m 

x(t) 

u(t) 

J 

1 

1 

1 

0.0256 
+ 1.6670f 

1.6004 

+ 5.9824£-6f 

0.0155 

2 

1 

2 

t + t 2 

1 + f 

0 


Figure 9: Exact and approximate trajectory functions for 
Example 2, n — 2,m = 2. 



Figure 1 1 : Exact and approximate trajectory functions for 
Example 3, n = 1, m = 1 . 



Figure 12: Exact and approximate control functions for 
Example 3, n = 1, m = 1 . 
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Figure 13: Exact and approximate trajectory functions for 
Example 3, n = l,m = 2. 



Figure 14: Exact and approximate control functions for 
Example 3, n = 1 , m = 2 . 


V. Conclusion 

Optimal control problems governed by non-linear 
Hammerstein integral equations are usually difficult to solve 
analytically and so it is necessary to obtain the approximate 
solutions. The present method is effective for cases where the 
known functions have sufficient derivatives in the given 
interval. One of the advantages of this method is that the 
optimal solutions, i.e. the trajectory and control functions, are 
expressed as a Taylor series truncated at t = C . Therefore 
x(t ) and u(t) can easily be evaluated for arbitrary values of 
t with a low computation at effort. This method will not work 
for cases where the given functions do not have enough 
derivatives. An interesting feature of this method is that we 
obtain analytical solution in many cases, as shown in the 
examples. 
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